1 What is claimed is: 

2 LA method of displaying motion guidance cues, namely the annotated "sliding" 

3 ghost metaphor. In addition to showing a computer character dance according to the motion 

4 (or dance) data, for any given time instance (say at t = tl), few frozen future motion frames 

5 (drawn as a transparent ghostly figure) of tl + kl*At,tl +k2* At, tl + k3*At,tl + k4*At, ... 

6 tl + kn*At are shown beside the main character as well. The ghosts are drawn at a fixed 

7 distance from the main character proportional to how advanced in time of frame it represents. 

8 Therefore, as time progresses, each frozen ghostly frame is seen as approaching toward, and 

9 finally merging into, the main frame. 

10 The number of frozen frames displayed (the value of n), values of ki's and the amount 

11 of basic time increment At is user settable (usually n = 3 and At = 0.5 second). Usually, ki's 

12 are set (by the developer) so that the frozen frames represent important "key postures" during 

13 a particular motion. These frozen motion frames of slight future are used as cues to remind 

1 4 players the next dance/stance/motion to perform/take. 

15 Key postures may be augmented with short texts/audio display (located in the lower 

16 part of the screen underneath the main character) to further inform the player of the 

17 next/current dance (motion) segment to perform (e.g. "hands up!", "disco time", etc.). The 

18 key postures and annotated texts/sounds are designated using a separate management tool 

19 preferably by the motion expert (e.g. dancer) and saved in a separate file. The motion of the 

20 player is captured by tracking five specific positions on the player's body (its mechanism to 

21 be explained later). These are the two wrists, two ankles and the belly. To give feedback and 

22 inform the player of how well one is following the motion on the screen, whenever the 

23 player's tracked positions fall within a threshold value of where it should be, the 

24 corresponding positions on the animated figure are highlighted with special effects (e.g. 

25 exploding lights) and is given commendation (e.g. "perfect", "excellent", "good", etc.). 
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1 2. A method of approximately tracking user's motion or collecting motion data 

2 in real time by both employing history based prediction and taking advantage of the reference 

3 motion data. At the beginning of the dance or motion, the player takes a known posture in 

4 order to initialize the marker's position. Thereafter, markers are tracked by using the 

5 marker's profile history, namely their travel direction, velocity and acceleration. To reduce 

6 image processing time, small windows for searching markers within are opened around 

7 predicted marker positions. When users make abrupt motions and thereby violate the 

8 prediction principle, the markers will be "missed" (markers are not present in the search 

9 window). After a few frames of empty search windows, the prediction windows are reset at 

10 new positions predicted by the original motion data. When tracked markers deviate too much 

1 1 from their course as predicted by the original motion, search windows are reset assuming that 

12 a "switched" marker problem has occurred and the player is making an attempt to follow the 

13 original motion. Such a prediction based approach reduces the computational cost and thus 

14 the overall hardware cost. 

15 3. A method of evaluating the motion of a game player by making a frame by 

16 frame comparison of the 3D position data of the important body positions. When a marker is 

17 missed, it can be interpreted as having too much deviation from the predicted path, thus 

18 resulting in a low score. In order to overcome the "offset" problem, where the player has 

19 managed to follow the motion qualitatively, but off the center position (thus resulting in a low 

20 score), a simple compensation can be made by monitoring the player's offset from the enter 

21 position. The offset is computed by estimating the center position of the player as being at 

22 the midpoint of one's two ankles (tracked by the cameras). Tracking the belly marker for this 

23 purpose is an unreliable method because it often gets confused with the passing wrist 

24 markers. The "delay" problem, in which the player is slightly late in following the motion, 
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1 can be overcome by applying "time shifts", by fitting the player's motion data to that of the 

2 original motion data at nearby critical points. 
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